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Abstract 

We offer a short tour into the interactive interpretation of sequential pro- 
grams. We emphasize streamlike computation ~ that is, computation of suc- 
cessive bits of information upon request. The core of the approach surveyed 
here dates back to the work of Berry and the author on sequential algorithms 
on concrete data structures in the late seventies, culminating in the design of 
the programming language CDS, in which the semantics of programs of any 
type can be explored interactively. Around one decade later, two major in- 
sights of Cartwright and Felleisen on one hand, and of Lamarche on the other 
hand gave new, decisive impulses to the study of sequentiality. Cartwright and 
Felleisen observed that sequential algorithms give a direct semantics to con- 
trol operators like call-cc and proposed to include explicit errors both in the 
syntax and in the semantics of the language PCF. Lamarche (unpublished) 
connected sequential algorithms to linear logic and games. The successful 
program of games semantics has spanned over the nineties until now, start- 
ing with syntax-independent characterizations of the term model of PCF by 
Abramsky, Jagadeesan, and Malacaria on one hand, and by Hyland and Ong 
on the other hand. 

Only a basic acquaintance with A-calculus, domains and linear logic is 
assumed in sections ^ through 01 



1 Prologue: playing with Bohm trees 

We first make some preparations. For self-containedness, we briefly recall the rele- 
vant notions. The syntax of the untyped A-calculus (A-calculus for short) is given 
by the following three constructions: a variable a; is a A-term, if M and are A- 
terms, then the application MN is a A-term, and if M is a term then the abstraction 
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Xx.M is a term. Usual abbreviations are \xiX2-M for Xxi.(\x2-M), and MN1N2 
for {MNi)N2, and similarly for n-arj abstraction and application. A more macro- 
scopic view is quite useful: it is easy to check that any A-term has exactly one of 
the following two forms: 



The first form is called a head normal form (hnf), while the second exhibits the head 
redex {Xx.M)Mi. The following easy property justifies the name of head normal 
form: any reduction sequence starting from a hnf Axi • • -Xn-xMi ■ ■ ■ Mp consists of 
an interleaving of independent reductions of Mi, . . . , Mp. More precisely, we have: 



Here, reduction means the replacement in any term of a sub-expression of the form 
{Xx.M)N, called a /3-redex, by M[x TV]. A normal form is a term that contains 
no /?-redex, or equivalently that contains no head redex. Hence the syntax of normal 
forms is given by the following two constructions: a variable x is a normal form, and 
if Ml, . . . , Mp are normal forms, then Xxi ■ ■ ■ Xn.xMi ■ ■ ■ Mp is a normal form. 

Now, we are ready to play. Consider the following two normal forms: 

M = zMiM2{XziZ2.ziM3M4) N = XxiX2X3.X3{Xyiy2.yiNi)N2 

The term M[z <— A^] = NMiM2{XziZ2-ZiM3M4^) is not a normal form anymore, and 
can be /3-reduced as follows: 



where N[, etc... are suitable substitution instances of A^i etc... But there is a more 
geometric way of describing the interaction of M and N. First, we represent M and 
N explicitly as trees (read from left to right), as follows: 



(n>l,p>l) Xxi- ■ -Xn.xMi- ■ ■ Mp 
{n>0,p> 1) Xxi ■ ■ ■Xn.{Xx.M)Mi ■ ■ ■ Mj 



p 




NMiM2{XziZ2. zi M3 M4 ) 



{XziZ2.ZiM3M^){Xy^y2.yiN[)N;, 

{Xym-yiN'^M^M^ 

M'r^N'l 
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Then we represent computation as the progression of two tokens in the two trees. 
Initially, the tokens are at the root (we use underlining to indicate the location of 
the tokens): 



Ml 
M2 

' Ms 



\Z\Z2- Z\ 
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We then notice that the token in has a choice of where to move right, while the 
one on the right has no choice. So let us take the latter as pilot: 



Ml 
M2 

, ; Ms 



AxiX2X3.Xs{^^^^-^^^^^ 



M4 

Here, x^ reads as "take the third branch" (in M): 



Ml 
M2 

, ; Ms 

A^l2;2. Zi 



AxiX2Xs.^{^;^-^^^^^ 



M4 

Notice that we are now in a situation where the token in M knows how to move 
next, while the one in N has a choice. We take M as pilot: 



Ml 
M2 

, ; Ms 

AZiZ2- Z\ 



M4 

We read zi as "take the first branch" (in A'") : 



Ml 
M2 

' M, 



^^1^2. £1^ M4 



XX1X2X3. X3 < — >- 



The following steps are: 
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Ml 



Ml 

M2 , / A2/12/2. 2/1 { A^i 



f Ms I 

We leave it to the reader to check that these steps follow closely the sequence of 
/^-reductions given above. The graphical presentation enhances alternation. The 
tokens' moves alternate between M and A^. There are two sorts of moves: variables 
(like z), and (bunches of) abstractions (hke \ziZ2.). We call these moves Player's 
moves and Opponent's moves, respectively. We can view an Opponent's move as 
the question "what is the head variable of the term rooted here?", and a Player's 
move as the answer to this question. So we see the computation as a progression of 
alternating moves describing a path in M (and in A^): 

Ml 

f XX1X2X3. X3 < — 

A£i£2:£i| 

Our example is actually too simple. The general mechanism needs an explicit ma- 
nipulation of pointers, when (unlike in the example) a variable is not bound by the 
immediate bunch of A's above. We refer the interested reader to where 
this machinery is described for a larger class of trees with pointers - called abstract 
Bohm trees -, of which Bohm trees are an example. Our main point here was to 
highlight interaction: M and are pilot in turn and tell the other which branch to 
choose. 

Suppose now that M3 = Xu-IM^Mq, where t is a free variable of M[z <— A^]. 
Then, looking back at the sequence of /9-reductions, we reach a head normal form: 

M;^A^{' = (AM.tM^M^)A^{' ^ tM^'M^' 

And, in geometrical form: 
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' Ml 
M2 

z < 



XziZ2. zi { -^^^ - 1 Me 
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Note here that cannot help to choose the next move in M. The machinery stops 
here. After all, most functional programming languages stop evaluation on (weak) 
head normal forms. But what about getting the full normal form, i.e., computing 
Mg and Mg ? The interactive answer to this question is: by exploration of branches, 
on demand, or in a streamlike manner. The machine displays t as the head variable 
of the normal form of M[z <— N]. Now, you, the Opponent, can choose which of 
the branches below t to explore, and then the machine will restart until it reaches 
a head normal form. For example, if you choose the first branch, then you will 
eventually reach the head variable of Mg . This is called streamlike, because that 
sort of mechanism has been first analysed for infinite lists built progressively. A 
A-term too has a "potentially infinite normal form" : it's Bohm tree. 

This prologue served the purpose of introducing some keywords, such as inter- 
activity, playful interpretation, streamlike computation. We now start from the 
beginning. 



2 Introduction 

Scott's and Plotkin's denotational semantics takes its roots in recursion theory. It 
is worth recalling here the statement of Rice's theorem. This theorem asserts a 
property of recursively enumerable (r.e.) sets of partial recursive (p.r.) functions, 
defined through a fixed enumeration of the p.r. functions (i.e. is a surjection 
from CO - the set of natural numbers - to a; ^ a;, using ^ for sets of partial functions) . 
Let PR C u! Lu denote the set of p.r. functions. A subset A C PR is called r.e. 
if {n \ (pn & A} is r.e. in the usual sense. The theorem asserts that if A is r.e. and 
if / G ^, then there exists a finite approximation g of f such that g & A. That g is 
an approximation of / means that / is an extension of g, i.e., the domain on which 
the partial function / is defined, or domain of definition of /, contains that of g and 
/ and g coincide where they are both defined. A simpler way of saying this is that 
the graph of g is contained in the graph of /. Moreover, the domain of definition of 
g is finite. Rice's theorem is about an intrinsic continuity property in the realm of 
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p.r. functions. It highlights the (complete) partial order structure of u ^ u, and in 
particular the presence of a bottom element _L in this partial order: the everywhere 
undefined function. 

Certainly, one of the key departure points taken by Scott was to take _L seriously. 
Once this element is part of the picture, one takes a new look at some basic functions. 
Take the booleans, for example. In Scott's semantics, this is not the set {tt,ff}, but 
the set {±, tt,ff'} ordered as follows: x < y if and only if x = y or x = 1. (this is 
called flat ordering). Take now the good old disjunction function or : Bool x Bool 
Bool. It gives rise to four different functions over the flat domain version of Bool 
(the specifications below can be completed to full definitions by monotonicity) : 



lor{±,y) 

loritt,!) 



por(±, tt) 


= tt 






por{tt, ±) 


= tt 






Por{-L,ff) 


= ± 






Por{ff,±) 








por{ff,ff) 








± 


ror 


{±,u) 


= tt 


tt 


ror 


(x,±) 




y 


ror 


{x,ff) 


= x 


sor(_L, tt) 








sor{tt, _L) 


= ± 






sori±,ff^) 


= ± 






sor{ff,±) 


= ± 






sor{ff,tt) 


= U 






soritt,ff) 


= tt 






sor{tt, tt) 


= tt 






sor{jf,ff) 


= ff 







It should be clear that lor and ror are computed by programs of the following 
shape, respectively: 



- . . , , 1 then tt X . . , , f then tt 

Xxy. It X = tt < ^ . ^ Xxy. if y = tt < 

^ ' else if y = • • • ^ ^ [ else if x = • • • 

On the other hand, it should be intuitively clear that no sequential program of 
the same sort can compute por, because a sequential program will 
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• either start by examining one of the arguments, say x, in which case it can't 
output anything before a value for x is given, thus missing the specification 
por(±, tt) = tt, 

• or output some value rightaway, say tt (Xxy.tt), thus mising the specification 
por{±, ±) = ±. 

For a formal proof that por is not sequentially definable, we refer to [HSl (syntactic 
proof), to [221 [section 6-1] (model-theoretic proof), and to ^[section 4.5] (via logical 
relations). As for sor, the story is yet different, there are two natural sequential 
programs for it: 



, ,, ( then if V = ■ • • . ,, [ then if X = ■ ■ • 

Axy. It X = tt < ^ . ^ Xxy. if y = tt < 

" \ elseify = --- y y y else if x = ■ ■ • 

The starting point of the model of sequential algorithms (next section) was to 
interpret these two programs as different objects Isor and rsor. Notice finally that 
there are many more sequential programs computing lor, ror, or sor. Another 
program for lor might e.g. look like 

then tt 

Xxy. if X = tt { ^ . , ,, f then tt 
^ * else if X = tt ' 



else if y = ■ ■ ■ 

Such a "stuttering" program is perfectly correct syntactically. Whether this 
program is interpreted in the model by an object different from the above program 
for lor is the departure point between the model of sequential algorithm on one 
hand and the more recent games semantics on the other hand. We shall come back 
to this point in the next section. 

Before we close the section, let us give some rationale for the names used in 
this section. As the reader might have guessed, the prefixes p, I, r, s, Is, rs stand for 
"parallel", "left", "right", "left strict", and "right strict", respectively. 



3 Symmetric algorithms, sequential algorithms 

We introduce enough formal definitions to give a self-contained introduction to se- 
quential algorithms, presented in the light of a games interpretation [12^ (following 
work of Lamarche [2Z|)- The proofs are omitted, but can be found in [5j [section 14.3], 
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except for what regards the coincidence between the two definitions of composition, 
for which the proof from jHj [section 3.6] can easily be adapted. 

Definition 3.1 ^ sequential data structure S = (C, V, P) is given by two sets C 
and V of cells and values, which are assumed disjoint, and by a collection P of 
non-empty words p of the form: 

Clf 1 ■ ■ ■ CnVn or CiVi ■ ■ ■ C„_iW„_iC„, 

where Ci E C and Vi E V for all i. Thus any p E P is alternating and starts with 
a cell. Moreover, it is assumed that P is closed under non-empty prefixes. We call 
the elements of P positions of S. We call move any element of M = C U V . We 
use m to denote a move. A position ending with a value is called a response, and 
a position ending with a cell is called a query. We use p (or s, or t), q, and r, to 
range over positions, queries, and responses, respectively. We denote by Q and R 
the sets of queries and responses, respectively. 

Let us pause here for some comments and perspective. An important step in 
the semantic account of sequential computing was taken by Berry, who developed 
the stable model in which the function par is excluded. Winskel described this 
model more concretely in terms of event structures, and Girard proposed a simpler 
form called coherence spaces, that led him to the discovery of linear logic JH] (see 
also 12] [chapters 12 and 13]). In event structures or coherence spaces, data are 
constructed out of elementary pieces, called events, or tokens. For example, the 
pair of booleans {tt,ff) is obtained as the set of two elementary pieces: {tt, ±) and 
{-L,fJ). More precisely and technically, the structure Bool x Bool as a coherence 
space has four events: tt.l, ff .1, tt.2, and ff .2. Then {tt,ff) is the set {tt.l, ff .2}. 

In a sequential data structure (or in a concrete data structure, not defined here) 
events are further cut in two "halves": a cell and a value, or an opponent's move 
and a player's move. The structure Bool x Bool as an sds has two cells ?.l and ?.2 
and has four values tt.l, ff .1, tt.2, and ff .2. An event, say tt.l, is now decomposed 
as a position (?.l) (tt.l). The best way to understand this is to think of a streamlike 
computation. Your pair of booleans is the output of some program, which will only 
work on demand. The cell ?.l reads as "I - another program, or an observer - want 
to know the left coordinate of the result of the program" , and tt.l is the answer to 
this query. 

An important remark, which will be further exploited in section is that this 
decomposition of events gives additional space: there is no counterpart in the world 
of coherence spaces or in any other usual category of domains of a structure with 
one cell and no value. 
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Definition 3.2 ^4 strategy of S is a subset x of R that is closed under response 
prefixes and binary non-empty greatest lower bounds (gib's): 

ri, r2 G X, ri A r2 7^ e =^ ri A r2 G x 

where e denotes the empty word. A counter-strategy is a non-empty subset of Q that 
is closed under query prefixes and under binary gib's. We use x,y, . . . and a, (], . . . 
to range over strategies and counter- strategies, respectively. 

If x is a strategy and if r & x , q = re for some c and if there is no v such that 
qv G X, we write q G A{x) (and say that q is accessible from x). Likewise we define 
r G A{a) for a response r and a counter- strategy a. 

Both sets of strategies and of counter- strategies are ordered by inclusion. They 
are denoted by D(S) and D-^(S), respectively. We write /C(D(S)) and /C(D^(S)) 
for the sets o/ finite strategies and counter- strategies, respectively. Notice that -D(S) 
has always a minimum element (the empty strategy, written or ^.), while D^{S) 
has no minimum element in general. 

A more geometric reading of tlie definitions of sds, strategy and counter-strategy 
is tlie following. An sds is a labelled forest, where the ancestor relation alternates 
cells and values, and where the roots are labelled by cells. A strategy is a sub-forest 
which is allowed to branch only at values. A counter-strategy a is a non-empty 
subtree which is allowed to branch only at cells. 

Let us see what collections of positions form and do not form a strategy in 
Bool X Bool. The set {(?.l) (tt.l) , (?.2) (#.2}) (representing is a strategy, 

while {(?.l) {tt.l) , (?.l) is not a strategy. A way to understand this is to 

say that the cell ?.l can hold only one value, which is the answer to the question. A 
strategy consists in having ready determinate answers for the movements of the op- 
ponent. If strategies are data, what are counter-strategies? They can be considered 
as exploration trees, see below. 

The pairs cell-value, query-response, and strategy-counter-strategy give to sds's 
a flavour of symmetry. These pairs are related to other important dualities in 
programming: input-output, constructor-destructor (see [13 )• It is thus tempting 
to consider the counter-strategies of an sds S as the strategies of a dual structure 

whose cells are the values of S and whose values are the cells of S. However, the 
structure obtained in this way is not an sds anymore, since positions now start with 
a value. This situation, first analysed by Lamarche j2H]; is now well- understood 
since the thesis work of Laurent [211 • come back to this below. 

The following definition resembles quite closely to the dynamics described in 
section [TJ 



9 



Definition 3.3 (play) Let S be an sds, x be a strategy and a be a counter- strategy 
ofS, one of which is finite. We define x | a, called a play, as the set of positions p 
which are such that all the response prefixes of p are in x and all the query prefixes 
of p are in a. 

Proposition 3.4 Given x and a as in definition \3.!A the play x\a is non-empty and 
totally ordered, and can be confused with its maximum element, which is uniquely 
characterized as follows: 

x\a is the unique element of x H A{a) if x \ a is a response 
X \ a is the unique element of ad A{x) if x \ a is a query . 

Definition 3.5 (winning) Let x and a be as in definition \3.'J[. Ifx \ a is a response, 
we say that x wins against a, and we denote this predicate by x<ia. If x \ a is a 
query, we say that a wins against x, and we write x>a, thus > is the negation of <. 
To stress who is the winner, we write: 

. f X ol a when x wins 
X \ a = < I ' , 
' 1^ X I > a when a wins . 

The position x | a formalizes the interplay between the player with strategy x 
and the opponent with strategy a. If x | a is a response, then the player wins since 
he made the last move, and if x | a is a query, then the opponent wins. Here is 
a game theoretical reading of x | a. At the beginning the opponent makes a move 
c: his strategy determines that move uniquely. Then either the player is unable to 
move (x contains no position of the form cv), or his strategy determines a unique 
move. The play goes on until one of x or a does not have the provision to answer 
its opponent's move (cf. section H]). 

We next define the morphisms between sds's. There are two definitions, a con- 
crete one and a more abstract one. The concrete one is needed since we want the 
morphisms to form in turn an sds in order to get a cartesian closed category (actu- 
ally a monoidal closed one, to start with). Accordingly, there will be two definitions 
of the composition of morphisms. Their equivalence is just what full abstraction 
- that is, the coincidence of operational and denotational semantics - boils down 
to, once we have tailored the model to the syntax (programs as morphisms) and 
tailored the syntax to the semantics (like in the language CDS 0). We start with 
the concrete way. 
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Definition 3.6 Given sets A, B C A, for any word w G A*, we define w\b as 
follows: 

w\b if m & A\B 

{wIb)^ if m E B . 



€\b= e wm\B= I 



Definition 3.7 Given two sds's S = (C, P) and S' = {C',V',P'), we define 
S —o S' = (C", V" , P") as follows. The sets C" and V" are disjoint unions: 

C" = {request c' | c' G C'} U {is v \ v e V} 
V" = {output v' \ v' e V'} U {valof c \ c e C} . 

P" consists of the alternating positions s starting with a request d , and which are 
such that: 

■sfs'e P', (s[s= e or s[se P), and 

s has no prefix of the form sivalof c) {request c'). 

We often omit the tags request, valof, is, output, as we have just done in the notation 
s\s= s \cuv ( '^'iT'd similarly for s\s')- 

We call affine sequential algorithms (or affine algorithms) from S to S' the strate- 
gies 0/ S ^ S'. 

The constraint 'no sec" can be formulated more informally as follows. Thinking 
of valof c as a call to a subroutine, the principal routine cannot proceed further until 
it receives a result v from the subroutine. 

The identity affine algorithm id G D{S — o S') is defined as follows: 
id = {copycat{r) | r is a response of S}, 
where copycat is defined as follows: 
copycat (e) = e 

copycatirc) = copycat (r) {request c) {valof c) 
copycat{qv) = copycat {q) {is v) {output v) . 

The word copycat used in the description of the identity algorithm has been proposed 
in [1], and corresponds to a game theoretical understanding: the player always 
repeats the last move of the opponent. In some infiuential talks, Lafont had taken 
images from chess (Karpov - Kasparov) to explain the same thing. 
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Example 3.8 (1) The following affine algorithm computes the boolean negation 
function: 

{{request l){valof ?), 

{request l){valof '^){is tt) {output ff), 

{request l){valof 1) {is ff) {output tt)} . 

(2) On the other hand, the left disjunction function cannot he computed by an affine 
algorithm. Indeed, transcribing the program for lor as a strategy leads to: 

{{request l){valof ?.l), 

{request l){valof 1 .l){is tt){output tt), 

{request l){valof 1 .l){is ff){valof ?.2), 

{request l){valof 1 .l){is ff){valof ?.2)(zs tt){output tt), 

{request ?){valof 1 .l){is ff){valof ? .2){is ff){output ff)} , 

which is not a subset of the set of positions of BooP -o Bool, because the projections 
on Bool^ of the last two sequences of moves are not positions of Bool'^ . But the 
program does transcribe into a (non-affine) sequential algorithm, as we shall see. 

(3) Every constant function gives rise to an affine algorithm, whose responses have 
the form {request d^) {output v[) . . . {request c'^) {output v'^).. 

The second and third example above thus justify the terminology affine (in the 
affine framework, in contrast to the linear one, weakening is allowed). The second 
example suggests the difference between affine and general sequential algorithms. 
Both kinds of algorithms ask successive queries to their input, and continue to pro- 
ceed only after they get responses to these queries. An affine algorithm is moreover 
required to ask these queries monotonically: each new query must be an exten- 
sion of the previous one. The 'unit' of resource consumption is thus a sequence of 
queries/responses that can be arbitrarily large, as long as it builds a position of the 
input sds. The disjunction algorithms are not affine, because they may have to ask 
successively the queries ?.l and ?.2, which are not related by the prefix ordering. 

A generic affine algorithm, as represented in figure ^ can be viewed as a 'com- 
bination' of the following (generic) output strategy and input counter-strategy (or 
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request c' valof c < 



IS vi ■ ■ ■ 



is Vi valof d < 



request c'l 



is w output V < 



request 



IS Vn 



Figure 1: A generic affine algorithm 



exploration tree): 



input counter-strategy output strategy 
f 

vx ■■■ 



c < Vi d I w 



c' v' 



We now give a definition of composition of affine algorithms by means of a 
simple abstract machine. Sequential algorithms are syntactic objects, and were 
indeed turned into a programming language called CDS |7j. What we present here 
is a simplified version of the operational semantics presented in ^3] [section 3.5] in 
the special case of affine algorithms. Given G -D(S ^ S') and 0' G -D(S' ^ S"), 
the goal is to compute on demand the positions that belong to their composition (j)" 
in the sds S — o S". The abstract machine proceeds by rewriting triplets (s, s', s") 



where s, s', s" are positions of S — o S', S' -<> S", and S -o S", respectively. 



The 
S", 



rules are given in Figure |21 (where P" designates the set of positions of S 
etc.): 

The first two rules are left to the (streamlike) initiative of the observer. Each 
time one of these rules is activated, it launches the machine proper, that consists 
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(r, r', 


r") - 


{r,r'c",r"c") 


{r"c" e P" 


(r, r', 


r") - 


_^ (^rv , r' c" , r" v) 


\r"v e P") 


l?^, q', 


q") - 


{r,q'v",q"v") 


{q'v" e <p') 




q") - 


{rc', q'c', q") 


{q'C e 4>') 


{q.r', 


.q") - 


— > {qv\ r'v', q") 


{qv' E (j)) 


iq,r', 


.q") - 


{qc, r', q"c) 


{qc e (j)) 



Figure 2: Composition abstract machine for affine algorithms 



of the four other (deterministic) rules. The generic behaviour of the machine is as 
follows. The initial triplet is (e, e, e). The observer wants to know the content of c", 
or more precisely wants to know what the function does in order to compute the 
contents of c" in the output. Thus, he chooses to perform the following rewriting: 

(e,e,e) — ' (e, e, c") 

The request is transmitted to cp': 

(e,6,c") (6,c",c") 

There are two cases here. Either (p' does not consult its input and produces imme- 
diately a value for c", in which case, this value is transmitted as the final result of 
the oberver's query: 

(e,c",c") {e,c"v",c"v") (cV G 0') 

Or (p' needs to consult its input (like the various sequential or functions), and then 
an interaction loop (in the terminology of Abramsky and Jagadeesan |2j) is initiated: 

{e,c",c") {c[,c"c[,c") {c"c[e<P') 

{c[v[,c"c[v[,c") {c'AecP) 
{cWA, c"c',v'A, c") (c"c>i4 G </>') 



This dialogue between and (p' may terminate in two ways. Either at some 
stage (p' has received enough information from (p to produce a value v" for c", i.e. 
Civ'i ■ ■ ■ c'yy G 0': 

{c[v[ . . . c>;, c"c[v[c'2 . . . c>;, c") — > {c[v[ . . . c>;, d'c'y-^c'^ . . . c»", c"v") 
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or itself says it needs to consult its input, i.e., c'^v[ . . .c'^^c G 0: this information 
is passed as a final (with respect to the query c") result to the observer, who then 
knows that (f)" needs to know the content of c. 

i.c'iV[ . . . C^, C"c[v[c'2 . . . C^, C") > (C>i . . . <C, C"c[v[c'2 . . . C^, c" c) 

It is then the observer's freedom to explore further the semantics of (f>" by issuing a 
new query (provided it is in P") : 

{c[v[ . . . c'y^, c"c[v[c'2 . . . c'yy, c"v") — ^ {cy . . . cy, d'cyd^ . . . cyy, c"v"c'i) 

or 

(c>i . . . cy c"cy^c2 ... 4, c"c) — > (c>i . . . cy d'dy^d^ . . . d'y 

The query d' cv reads as: "knowing that 0" needs c, how does it behave next when 
I feed V to c" . After this, the computation starts again using the four deterministic 
rules along the same general pattern. Notice how and 0' take in turn the leadership 
in the interaction loop (cf. section ^ 

We now turn to the abstract definition of our morphisms. 

Definition 3.9 A (continuous) function f : D{S) —>■ D{S') is called stable if for 
any x G D{S),a' G K,{D-^ such that S')), /(z)<la' there exists a minimum (finite) 
y < X such that f{y)<a' (m{g,a',x), denoted by m{f,x,a'). One defines similarly 
a notion of stable function g : D-'-(S') ^ D^{S), with notation m{g,a',x). 

Definition 3.10 (symmetric algorithm) LetS andS' be two sds's. A symmetric 
algorithm from S to S' is a pair 

(/:D(S) DiS'),g:D\S')^D^iS)) 

of a function and a partial function that are both continuous and satisfy the following 
axioms: 



(L) {xE D{S),a' G /C(D^(S')), fix)<ia') 
(R) (a' G D^{S'),x e IC{D{S)),x>g{a') 



x<ig{a') and 

m{f, x,a') = X < \ g{a') 

f{x)t>a' and 
m{g,a',x) = f{x) \> a' 
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We set as a convention, for any x and any a' such that g{a') is undefined: 

x<g{a') and x <l| g^a') = 0. 

Hence the conclusion of (L) is simply m.{f,x,a') = when g{a') is undefined. In 
contrast, when we write x>g{a') in {R), we assume that g{a') is defined. 

Thus, g provides the witnesses of stabihty of /, and conversely. Moreover, the above 
definition is powerful enough to imply other key properties of / and g. 

Definition 3.11 A (continuous) function f : -D(S) — >• -D(S') is called sequential 
if, for any pair {x,a') e /C(D(S)) x IC{D^{S')) such that f{x)t>a' and f{z)<ia' for 
some z >x, there exists a e ]C{D^{S)), called a sequentiality index of f at {x,a'), 
such that x>a and for any y > x, f{y)<a' implies y<a. 

Proposition 3.12 Let f and g be as in the previous definition. Then f and g are 
affine (i.e., preserve the least upper bounds of pairs of upper bounded elements) and 
satisfy the following two axioms: 

(LS) If X E D{S), a' e ]C{D^ {S'j) , f {x)>a' , and f{y)<]a' for some y > x, then 
x>g{a'), and x \ > g{a') is a sequentiality index of f at {x,a'). 

(RS) If a' e D^{S'), X e 1C{D{S)), x<g{a'), and x>g{P') for some (3' > a', then 
f{x)<ia', and f{x) <] \ a' is a sequentiality index of g at {a',x). Hence f and 
g are sequential, and g provides the witnesses of sequentiality for f and con- 
versely. 

We turn to the composition of affine algorithms. 

Definition 3.13 Let S, S' and S" be sds's, and let {f,g) and {f',g') be symmetric 
algorithms from S to S' and from S' to S". We define their composition (/", g") 
from S to S" as follows: 

f^f'of and g"^gog'. 
The announced full abstraction theorem is the following. 

Theorem 3.14 The sets of affine algorithms and of symmetric algorithms are in 
a bijective correspondence (actually, an isomorphism), and the two definitions of 
composition coincide up to the correspondence. 
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We just briefly indicate how to pass from one point of view to the other. Given 
G D{S — o S'), we define a pair (/, g) of a function and a partial function as follows: 



(By convention, if the right hand side of the definition of g is empty for some a', we 
interpret this definitional equality as saying that g{a') is undefined.) 

Conversely, given a symmetric algorithm {f,g) from S to S', we construct an 
afline algorithm (p G D{S S') by building the positions s of by induction on 
the length of s (a streamlike process!). For example, if s G 0, if s\s and s\s' are 
responses, and if q' = {s\s')c' for some c', then: 



But, as remarked above, we do not get all sequential functions in this way. Recall 
that in linear logic the usual implication A ^ B is decomposed as {\A) -o B (!, and 
its de Morgan dual ?, are called exponentials in linear logic). 

Definition 3.15 (exponential) Let S = (C, V, P) he an sds. We set !S = (Q, R, Pi), 
where Q and R are the sets of queries and of responses of S, respectively, and where 
P\ is recursively specified as follows (letting p range over responses in P\): 

pqeP z/g G v4(strategy(p)) 

pq{qv) G Pi if pq G P, strategy(pg(gt;)) G D{M), and qv ^ strategy(p) 
where strategy is the following function mapping responses (ore) of P to strategies 



strategy(e) = strsLtegy {pq{qv)) = strategy(r) U {qv}. 

Sequential algorithms between two sds's S and S' are by definition affine algorithms 
between !S and S'. 

It is easily checked that the programs for lor (cf. example 13. 8p . ror, Isor, and 
rsor transcribe as sequential algorithms from Bool x Bool to Bool. 

Sequential algorithms also enjoy two direct definitions, a concrete one and an 
abstract one, and both an operational and a denotational definition of composition, 
for which full abstraction holds, see jEj. 



{r' I r' = s\s' and s\s& x for some s G 0} 
{g I g = s[s and s\s'& ol for some s G 0}. 



sc'cG0 if (s[s)c G 5'(g') 
sdv' G if ((v' G /(s[s) • 



o/S.- 
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Let us end the section with a criticism of the terminology of symmetric algorithm. 
As already pointed out, the pairs {f,g) are not quite symmetric since g unlike / is 
a partial function. Logically, S — o S' should read as S^'S'S'. But something odd 
is going on: the connective ^ would have two arguments of a different polarity: in 
S' it is Opponent who starts, while Player starts in S"*". For this reason, Laurent 
proposed to decompose the affine arrow [221 (see also jS]): 

S ^ S' = (i S)^>S>S' 

where | is a change of polarity operator. For sds's, this operation is easy to define: 
add a new initial opponent move, call it -k, and prefix it to all the positions of S"*". 
For example, | {Bool'^) has -k 7 tt and -k 7 jf as (maximal) positions. According 
to Laurent's definition, the initial moves of 81^82 are pairs (01,02) of initial (Op- 
ponent's) moves of 81 and 82- Then the positions continue as interleavings of a 
position of 81 and of 82. Notice that this is now completely symmetric in 81 and 
82. 

Now, let us revisit the definition of 8 — <3 8'. We said that the positions of this 
sds had to start with a c', which is quite dissymetric. But the J, construction allows 
us to restore equal status to the two components of the ^. A position in 8-'-^8' 
must start with two moves played together in 8 and 8'. It happens that these moves 
have necessarily the form (*, c'), which is conveying the same information as c'. 

4 Related works 

Sequential algorithms turned out to be quite central in the study of sequentiality. 
First, let us mention that Kleene has developed (for lower types) similar notions 
under the nice name of oracles, in his late works on the semantics of higher 
order recursion theory (see [HI for a detailed comparison). 

Two important models of functions that have been constructed since turned 
out to be the extensional collapse (i.e. the hereditary quotient equating sequential 
algorithms computing the same function, i.e. (in the affine case) two algorithms 
{f,g) and {f',g') such that / = /'): Bucciarelli and Ehrhard's model of strongly 
stable functions (TUIIIH], and Longley's model of sequentially realizable functionals 
[3T]. The first model arose from an algebraic characterization of sequential (first- 
order) functions, that carries over to all types. The second one is a realizability 
model over a combinatory algebra in which the interaction at work in sequential 
algorithms is encoded. 



18 



Also, Laird has shown that sequential algorithms can be obtained by a collapsing 
construction from his games model of control in Hyland and Ong style pBj . 

Hyland and Ong's model and Abramsky-Jagadeesan-Malacaria's model (HO and 
AJM, respectively) capture PCF definability exactly, whereas the games associated 
with sequential algorithms also accommodate control operations such as call-cc 
that are not definable in PCF (see sectional). In fact, the interpretation function 
from normal forms to these models is injective. An essential merit of these works 
was to characterize the image of this injection, and hence to characterize PCF de- 
finability in a syntax-independent way by a few conditions such as innocence and 
well-bracketing. This opened the way to a whole research program launched by 
Abramsky. What does happen if one of the conditions is relaxed? Giving up in- 
nocence led to very interesting (and fully abstract) models of references (see jl]). 
Giving up well-bracketing gave a model of PCF plus control, as already mentioned. 

The model of sequential algorithms and the HO (or AJM) model differ drastically 
in size. The type Bool Bool is interpreted by a finite sds (i.e., an sds with finitely 
many positions) in the model of sequential algorithms, while there are infinitely 
many PCF Bohm trees (and hence infinitely many strategies) in the HO and AJM 
models at that type. The difference comes from the way the exponential is defined. 
In definition 13. 151 a key feature is non-repetition [qv ^ strategy(p)). In the games 
models, the exponential is defined either by interleaving allowing for repetitions 
or by the opening of potentially infinitely many copies of positions. Roughly, this 
amounts to dropping the condition qv ^ strategy (p). 

The finitary nature of sequential algorithms implies that equality in the model is 
decidable for any type built over Bool, while the term model games do not provide 
effective tools to tackle observational equivalences. As a matter of fact, it has been 
proved by Loader jSU] that equality of two objects in the fully abstract model of 
(finitary) PCF is undecidable. A model of PCF is called fully abstract if it equates 
two terms if and only if these terms are observationally equivalent, which means 
that one can be replaced by the other in any program context without affecting 
the final result. The full abstraction problem of Scott, Milner and Plotkin was the 
(quite loosely) specified problem of providing a denotational construction of the 
fully abstract model of PCF, as opposed to the original term-based construction 
of Milner, who also had shown the uniqueness of the fully abstract model [S2]- 
The HO and AJM games models can be called denotational, since they provide a 
syntax-independent characterization of a term model made of (a PCF version of) 
Bohm trees. But they yield full abstraction only via a collapse construction which 
is not essentially different from the one originally performed by Milner. An implicit 
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hope was to arrive at decidability results for the equality in the model, as usual 
denotational models consist of functions, and hence interpret every type built over 
Bool by a finite set. Loader's result says that there cannot be such a construction of 
the fully abstract model of PCF, and justifies a posteriori why game models had to 
use infinitary exponentials. In contrast, when PCF is extended with control, then 
the finitary exponential of the model of sequential algorithms does the job (coming 
next). 

5 Control 

We already pointed out that theorem 13.141 is a full abstraction result (for the 
affine case), and that the same theorem has been proved for all sequential algo- 
rithms with respect to the language CDS. Sequential algorithms allow inherently 
to consult the internal behaviour of their arguments and to make decisions accord- 
ing to that behaviour. For example, there exists a sequential algorithm of type 
{BooP — > Bool) — >• Bool that maps Isor to tt and rsor to jj (cf. end of section 2). 
Cartwright and Felleisen made the connection with more standard control operators 
explicit, and this lead to the full abstraction result of sequential algorithms with 
respect to an extension of PCF with a control operator [T^ . 

In this respect, we would like to highlight a key observation made by Laird. 
Let be the sds with one cell and no value: o = {{?},0, {?}}. Then we have the 
isomorphism 

Bool ~ (o ^ o — s> o) 

where Bool is the sds {{?}, {tt,ff}, {?, (?ti), (Jff)}} considered above. Indeed, both 
sds's have exactly three strategies, ordered in the same way: 

D{Bool) = {^,{?tt},{7jf}} 
D(o^o^o) = {iD,{7J,},{7, h}} 

(we use subscripts to decorate the cells of the three copies of o, using the convention 
Oi ^ 02 ^ Oe). It is an instructive exercise to write down explicitly the inverse 
isomorphisms as sequential algorithms: in one direction, one has the if then else 
function, in the other direction, we have the control operation catch considered 
in which tells apart the two strategies , {?e ?i},{?£ ?2}. Here, we shall show 
(at type bool) how the control operator call-cc of Scheme or Standard ML is 
interpreted as a sequential algorithm of type {{bool ^ B) —>■ bool) —>■ bool. The 
formula {{A —>■ B) —>■ A) ^ A is called Pierce's law and is a typical tautology of 
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classical logic. The connection between control operators and classical logic - and 
in particular the fact that call-cc corresponds to Pierce's law- was first discovered 
in [21]. Here is is the sequential algorithm interpreting call-cc for A = boot. 



(with labelling of moves {{boolm Bu) booli) bool^). The same algorithm, 
with bool replaced hj o —>■ o —>■ o, is: 



(with labelling (((onn ou^) Oin Bu) 012 -^13^ Oi) ^02^03^ o,). 
The reader familiar with continuations may want to compare this tree with the 
continuation-passing (CPS) style interpretation Xyk.y{Xxk' .xk)k of call-cc, or in 
tree form (cf. section P): 



where the first k indicates a copy-cat from om to while the second one indicates 
a copycat from oi to o^. The bound variable k' amounts to the fact B itself is of 
the form B' o (see below). This is an instance of the injection from terms to 
strategies mentioned in section 0] (in this simple example. Laird's HO style model 
coincides with that of sequential algorithms). 

CPS translations are the usual indirect way to interpret control operators: first 
translate, then interpret in your favorite cartesian closed category. In contrast, 
sequential algorithms look as a direct semantics. The example above suggests that 
this is an "illusion": once we explicitly replace bool by o — o — >■ o, we find the 
indirect way underneath. 

A more mathematical way to stress this is through Hofmann-Streicher's notion of 
continuation model p3j: given a category having all the function spaces A ^ R for 
some fixed object R called object of final results, one only retains the full subcategory 
of negative objects, that is, objects of the form A R. In this category, control 
can be interpreted. (For the logically inclined reader, notice that thinking of R as 
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the formula "false", then the double negation of A reads as {A ^ R) ^ R, and 
the classical tautology {{A ^ R) — > i?) ^ A is intuitionistically provable for all 
negative A = B ^ R.) Now, taking R = o, the above isomorphism exhibits bool as 
a negative object. But then all types are negative: given A and B = B' ^ R, then 
A B {A X B') ^ R is also negative. Hence the model of sequential algorithms 
(and Laird's model of control) are indeed continuation models, but it is not written 
on their face. 

6 A few more remarks 

We would like to mention that this whole line of research on sequential interaction 
induced such side effects as the design of the Categorical Abstract Machine [TT] , 
that gave its name to the language CAML, and of a theory of Abstract Bohm Trees, 
alluded to in section [T] 

As for future lines of research, imports from and into the program of Indies newly 
proposed by Girard [20] are expected. We just quote one connection with Indies. 
We insisted in section |21 that Isor and rsor were different programs for the same 
function. But there is a way to make them into two different functions, by means 
of additional error values, and accordingly of additional constants in the syntax. 
Actually, one error is enough, call it err. Indeed, we have: 

lsor{err, ±) = err rsor{err, ±) = ± . 

Because Isor looks at its left argument first, if an error is fed in that argument, 
it is propagated, whence the result err. Because rsor looks at its right argument 
first, if no value is is fed for that argument, then the whole computation is waiting, 
whence the result _L. One could achieve the same more symmetrically with two 
different errors: lsor{erri, err2) = erri, rsor{erri, err2) = err2. But the economy of 
having just one error is conceptually important, all the more because in view of the 
isomorphism of sectional we see that we can dispense (at least for bool but also for 
any finite base type) with the basic values tt,ff, 0, 1, . . .. We arrive then at a picture 
with only two (base type) constants: ± and err! This is the point of view adopted in 
Girard's Indies. In Indies, the counterpart of err is called Daimon. The motivation 
for introducing Daimon is quite parallel to that of having errors. Girard's program 
has the ambition of giving an interactive account of proofs. So, in order to explore 
a proof of a proposition A, one should play it against a "proof" of A-^ (the negation 
of linear logic). But it can't be a proof, since not both A and A-^ can be proved. 
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So, the space of "proofs" must be enlarged to allow for more opponents to interact 
with. Similarly, above, we motivated errors by the remark that, once introduced, 
they allow more observations to be made: here, they allowed us to separate Isor and 
rsor. More information, also of a survey kind, can be found in ^7]. 
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